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he goal of most interven- 
tional studies is to estab- 
lish a cause-and-effect 
relationship between the 
intervention and one or more out- 
comes. A retrospective study design 
utilizing existing clinical data is a 
relatively quick and inexpensive way 
to collect pilot data, which can be 
helpful in identifying feasibility is- 
sues and designing a future prospec- 
tive study (Hess, 2004). 

The study by Donald, Tobin, and 
Stringer (2011) discussed on page 
178 by Constance Visovsky, PhD, RN, 
APRN-BC, describes a possible cause- 
and-effect relationship between acu- 
puncture and chemotherapy-induced 
peripheral neuropathy (CIPN) using 
a retrospective design. Studies that at- 
tempt to evaluate efficacy of an inter- 
vention using a retrospective design 
are subject to numerous threats to 
validity, which limit the interpreta- 
tion and generalizability of the results 
(Trochim, 2005). These threats are 
summarized in Table 1. 

The single-group design often em- 
ployed in retrospective studies limits 
the researchers' ability to determine 
cause and effect. Although it is usually 
not possible to include a control group 
in a retrospective study, whenever pos- 
sible a control group should be included 



to help establish the cause-and-effect 
relationship. Random assignment helps 
ensure that groups are similar to each 
other before treatment, so study out- 
comes cannot be attributed to anything 
other than the intervention. 

The Donald, Tobin, and 
Stringer Study 

In the acupuncture study, histori- 
cal threats may have influenced the 
results. It is unclear how many of the 
participants had already completed 
chemotherapy, in which case symp- 
toms may have improved as a result of 
time and withdrawal of the neurotox- 
ic agent(s). The single-group design 
in this study limits the researchers' 
ability to determine differences be- 
tween the group who received acu- 
puncture and a similar group who did 
not receive acupuncture. 

Social Pressure 

Patients provided with interven- 
tions in clinical settings may feel social 
pressure to respond positively to the 
question of whether the intervention 
provided the desired effect (King & 
Bruner, 2000). Especially when data 
are collected by the health-care team 
providing services to the patient, so- 
cial desirability bias is a highly plau- 
sible explanation for success of the 
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Table 1 Common Threats to Internal Validity in Retrospective Studies 


Type of Threat 


Description 


Single-group threat 


Lack of comparison or control group 


Historical threat 


Another event, other than the intervention, 
influences the outcome. 


Maturation threat 


Normal growth or maturation influences the 
outcome. 


Testing threat 


The pretest makes participants more aware of what 
is being studied, influencing performance on the 

nn^ttp^t 


Statistical regression 
threat 


A statistical phenomenon in which scores move 

Lwvvciiu li ic fjufju la liui i iiitrciii, LdUoii ly o^uico lu 

change from pretest to posttest but not as a result 
of the intervention 


Mortality threat 


High rate of attrition influences the outcome. 


Instrumentation threat 


Selection and use of instruments influence the 
outcome. 


Social interaction threat 


Social relationships and interactions with others 
influence the outcome. 


Note. Information from Trochim (2005). 
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intervention. Similarly, a phenomenon known as 
the Hawthorne effect may cause participants to 
report more favorable outcomes because they are 
receiving closer attention or being more closely 
evaluated as a result of participation in a study 
(McCarney et al., 2007). Addition of a control 
group that would provide participants with a 
similar amount of attention and evaluation as the 
intervention group helps control for both social 
desirability bias and the Hawthorne effect. 

Instrumentation 

Another major threat to validity is instru- 
mentation. Although no gold standard exists for 
measurement of CIPN (Dunlap & Paice, 2006), 
there are several instruments available for mea- 
surement of CIPN that have demonstrated reli- 
ability and validity (Almadrones, McGuire, Wal- 
czak, Florio, & Tian, 2004; Huang, Brady, Cella, 
& Fleming, 2007; Tofthagen, McMillan, & Kip, 
2011). Eliciting patient preferences and percep- 
tions regarding efficacy is an important aspect of 
patient care; however, opinions without the use 
of reliable and valid measures of the outcome 
variable should be avoided in clinical research. 
Valid instruments have undergone evaluation to 
determine the extent to which they actually mea- 
sure the concept they intend to measure (Waltz, 



Strickland, & Lenz, 2005). 
If a blood pressure cuff 
is used to measure tem- 
perature, even though 
the blood pressure cuff 
is working as it should, 
it is an invalid measure 
of temperature. Reliable 
instruments consistently 
produce the same results 
in the same circumstanc- 
es. If the blood pressure 
cuff reveals hypertension 
on the first measurement 
and hypotension in the 
same hemodynamically 
stable patient 30 seconds 
later, that blood pressure 
cuff is an unreliable mea- 
sure of blood pressure, at 
least until it can be cali- 
brated and/or repaired. 
Just as using a valid and 
reliable instrument to measure blood pressure 
is important in practice, using valid and reliable 
measurement tools is equally important in re- 
search. 

External validity refers to the generaliz abil- 
ity of the findings to other samples. In interven- 
tional studies for CIPN, generalizing the results 
to a specific population may not be possible when 
participants differ in respect to factors that can 
be expected to influence outcomes such as can- 
cer type, chemotherapy doses, and chemotherapy 
drugs. It is likely that patients who develop CIPN 
from one neurotoxic chemotherapy may differ in 
response from those who receive other types of 
neurotoxic chemotherapy. 

Conclusion 

Retrospective designs provide a vehicle for re- 
search using existing data but can be riddled with 
threats to both internal and external validity. Al- 
though a cause-and-effect relationship cannot be 
determined using retrospective studies, they are 
useful for providing preliminary data and in guid- 
ing the development of future prospective studies. 
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